Strategy, Leadership, and Narratives: Data Viz for Policy Change

Jared E. Knowles

May 6, 2014

Outline

  • This talk will focus on 5 graphics as an illustration of the principals of policy focused data visualization


plot of chunk unnamed-chunk-1

The Principles

Know thy data, and know thy audience better.



  • What is their question?
  • What is their timeframe?
  • What are their constraints?
  • What is their capacity?

On Audience


Your audience can understand much more than you may think. It is all in how you lead them there.

The Barriers


  • Time
  • Data
  • Tools
  • Tech

Yahbut - too much data

Data is Everywhere

Yahbut - too many priorities

Under pressure
Under pressure

Yahbut - unclear direction

Data is Everywhere

The Way Out


  1. Identify your goals (strategy)
  2. Explore your data and focus (analysis)
  3. Focus even narrower (leadership)
  4. Find the context (context)
  5. Put it together (presentation)



Use the data to make a visualization that presents an argument supported by evidence.

Strategy: What can this data say?

Wisconsin FRL Map
Wisconsin FRL Map

Of Metrics and Dashboards

Widgets provide limited connection to strategy.

Infographic, or confusion?

Analyze your data to find the meaning

What is the goal of this graphic?

Word cloud, or clouded message?
Word cloud, or clouded message?

What did we learn?

  • The words obviously and education were used a lot
  • Some other words were frequent too
  • What do the colors mean?


What value have we provided?

Exploratory vs. Explanatory

Exploratory graphics are what we use to understand the features of a dataset



Explanatory graphics are polished and annotated graphics that convey a fact or argument clearly

Exploratory

Exploring Group Differences

Explanatory

Cumulative Assessment Density

What have we learned?

  • Strong link between ACT and WKCE scores
  • Not only does the mode shift with WKCE percentile, but the variation shifts as well
  • Low WKCE scores mean a low chance at meeting the ACT benchmark

An aside on complexity

  • Yes, these graphics are more complex
  • Explaining one complex graphic to the audience with a strong meaning is powerful
  • Many superficial graphics have a harder time conveying a strong message
  • In education we are fortunate to have smart audiences

Leadership means making the point clear

Student Growth in WI
Student Growth in WI

What did we learn?

  • Student mobility across proficiency categories is hard
  • Student growth is parallel across percentiles
  • Students regress as well as grow
  • Assessment measures can be noisy

Context

Showing Models

Context as Key

  • Education viz is littered with plots without context or reference points
  • Context is what creates urgency, helps focus decision making, and allows tradeoffs to be balanced
  • Moves the conversation forward
  • Focuses us on the issue at hand
  • Reduces complexity without throwing away data

Some Solutions

Technology Choices in Viz

Don’t Underestimate Your Audience

  • 1 polished detailed graph is better than 10 simple throwaway graphs
  • Provide context and remember your limits as a presenter
  • Link your graphic to things leadership cares about
  • If complexity is required, explain it better!

Simulation

Skip the data

Density

Counterfactual Modeling

Show what should be

Density

Thank You and Contact Info